Max-Margin Contrastive Learning

نویسندگان

چکیده

Standard contrastive learning approaches usually require a large number of negatives for effective unsupervised and often exhibit slow convergence. We suspect this behavior is due to the suboptimal selection used offering contrast positives. counter difficulty by taking inspiration from support vector machines (SVMs) present max-margin (MMCL). Our approach selects as sparse vectors obtained via quadratic optimization problem, contrastiveness enforced maximizing decision margin. As SVM can be computationally demanding, especially in an end-to-end setting, we simplifications that alleviate computational burden. validate our on standard vision benchmark datasets, demonstrating better performance representation over state-of-the-art, while having empirical convergence properties.

برای دانلود رایگان متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Efficient Max-Margin Metric Learning

Efficient learning of an appropriate distance metric is an increasingly important problem in machine learning. However, current methods are limited by scalability issues or are unsuited to use with general similarity/dissimilarity constraints. In this paper, we propose an efficient metric learning method based on the max-margin framework with pairwise constraints that has a strong generalizatio...

متن کامل

Learning Max-Margin Tree Predictors

Structured prediction is a powerful framework for coping with joint prediction of interacting outputs. A central difficulty in using this framework is that often the correct label dependence structure is unknown. At the same time, we would like to avoid an overly complex structure that will lead to intractable prediction. In this work we address the challenge of learning tree structured predict...

متن کامل

Max-Margin Multiple-Instance Dictionary Learning

Dictionary learning has became an increasingly important task in machine learning, as it is fundamental to the representation problem. A number of emerging techniques specifically include a codebook learning step, in which a critical knowledge abstraction process is carried out. Existing approaches in dictionary (codebook) learning are either generative (unsupervised e.g. k-means) or discrimina...

متن کامل

Contrastive Max-Sum Opinion Summarization

People can reach all kinds of information online including reviews and comments on products, movies, holiday destinations and so on. However, one usually need to go through the reviews to have an objective opinion the positive and the negative aspects of the item reviewed. We aim to provide a method that will extract positive and negative opinions on a specific aspect and compare them in an att...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

ژورنال

عنوان ژورنال: Proceedings of the ... AAAI Conference on Artificial Intelligence

سال: 2022

ISSN: ['2159-5399', '2374-3468']

DOI: https://doi.org/10.1609/aaai.v36i8.20796